Multi-lepton signals from the top-prime quark at the LHC 
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We analyze the collider signatures of models with a vector-like top-prime quark and a massive 
color-octet boson. The top-prime quark mixes with the top quark in the Standard Model, leading 
to richer final states than ones that are investigated by experimental collaborations. We discuss 
the multi-lepton final states, and show that they can provide increased sensitivity to models with 
a top-prime quark and gluon-prime. Searches for new physics in high multiplicity events are 
an important component of the LHC program and complementary to analyses that have been 
performed. 



1 Introduction 

The top quark discovery at the Tevatron, made more 
than a decade ago, has completed the quark sec- 
tor of the standard model (SM). It is imperative to 
ask whether physics beyond the SM includes addi- 
tional quarks, and in particular, whether there are 
any heavier quarks with collider signatures similar 
to those of the top quark. Given that electroweak 
observables are highly sensitive to the presence of ex- 
tra chiral fermions, the existence of vector-like (i.e., 
non-chiral) fermions have been extensively investi- 
gated in literature [lj. They can easily evade all 
experimental constraints because their effects decou- 
ple in the limit of large fermion masses. Given that 
the masses of vector-like fermions are not protected 
by the electroweak symmetry, they are likely to be 
larger than the electroweak scale. As a result, even 
if vector- like fermions exist, it is natural that they 
have not been discovered so far. 

We focus on the phenomenology of a vector-like 
quark (top-prime quark) that mixes with the SM 
top. Experimental collaborations at the Tevatron 
and the LHC have searched for t' pair production, 
where t! is a hypothetical quark assumed to decay to 
a W boson and a jet, hence appearing in collider ex- 
periments ELS £1 heavier copy of the top quark. More 
recently the CMS collaboration investigated the t' 
decay to the t Z final state. In this article we dis- 
cuss the multi-lepton final states that arise due to 
the decays of top-prime quarks. In particular, we 
study collider implications of top-prime quarks at 
the LHC in models with a heavy color-octet vector 
boson (gluon-prime, G'). In many such models, a 
SU(3)\ Cg) SU(3)2 gauge group is spontaneously bro- 
ken down to its diagonal subgroup SU(3) C which is 



identified with the QCD gauge symmetry. 

The two hypothetical particles discussed here are 
part of various models for TeV scale physics. In the 
top quark seesaw model [2H1], the vector- like quark 
binds to the top quark forming a Higgs boson, with 
binding provided by the coloron. The gauge sym- 
metry breaking of SU(3)i ® SU(3) 2 -> SU{3) C has 
been used in many models such as topcolor models of 
Higgs compositeness [I]l5] and was one of the motiva- 
tions for studying models with extra dimensions [6j . 
Color-octet bosons may also be composite particles, 
such as one of the p techni- mesons [I]. In certain 
models with a flat [7J or warped |8j extra dimension, 
the vector-like quark and the gluon-prime appear as 
Kaluza-Klein modes. Rather than imposing here any 
of the constraints among parameters present in these 
models, we consider a generic renormalizable theory 
that includes these two particles following Ref. [9]. 

In Section 2 we briefly review the model. We 
then consider various experimental constraints on 
the t'+G' model in Section 3. We present its im- 
plications for the LHC searches in the multi-lepton 
final state in Section 4. A concluding discussion is 
given in Section 5. 

2 Model 

The complete description of the model we consider is 
given in Ref. [9]. As stated in the introduction, the 
model is an extension of the SM with a heavy color- 
octet gluon-prime and a heavy top-prime quark. The 
model is fully described by four extra free parame- 
ters, the masses of both the gluon-prime and the top- 
prime, and the coupling parameters r, and sinO^. 

The parameter, r, is defined as the ratio of the 
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coupling of the gluon-prime (gcqq) to the SM strong 
coupling constant (g s ). For example, the coupling 
between the gluon-prime and the light quarks are 
all given by 

9G'qq = 9 s r. (1) 

The final free parameter is sin#i(= s£) which de- 
scribes the mixing between left handed components 
of the SM top quark and the top-prime quark. The 
right handed mixing components svhOr{= sr) can 
be written in terms of the other free parameters so 
it is fixed, 



sr 



s\m 2 t , + c^m 2 



(2) 



where mf and mt are the masses of the top-prime 
and top quark, cos 2 9l = c 2 = 1 — s 2 and cos 2 9r = 

C R = ^ ~ S R- 

For the purposes of this study we are only con- 
cerned with the couplings of the top quarks to the 
gauge bosons (both gluons and electroweak bosons). 
The interactions of the gluons to the top quarks are 
given by the following term in the Lagrangian 

g s G'-tY(g'[P L + g'RPR)T a t', (3) 
9s a; {g' L PL + g' R P R ) TH> + h.c. , (4) 

where the Pl/r = l ^ are the chiral projection 
operators, 7^ , 7 s are the Dirac Gamma matrices, 
T a (a = 1, • • • , 8) are the generators of SU(3) C color 
group, and the gis are defined as 



9l = rs L 



9l 



1 + - ) s L c L , (5) 



with analogous equation for the <?_r's. These terms 
give us the favored production method for the top- 
prime quarks (pair production and associated pro- 
duction) via an s-channel gluon-prime. To describe 
the decay processes of the top-prime we write the 
interactions with the electroweak gauge bosons 



W+b L ^{c L t L + s L t' L ) + h.c. , 



ff2 

g-i z 

cos Q\y 



L 2 



(t'Ll»t L ) + h.c. 



(6) 
(7) 



These interaction terms give us the top-prime de- 
cays, t' —7- W + + b and t' — > tZ. Though the branch- 
ing fractions are dependent on the model parame- 
ters, they are generally > 50% and < 25% respec- 
tively. 



3 Current Experimental Bounds 

In this section, we consider the experimental con- 
straints on the t' + G' model based on the inter- 
action in the previous section. Following Ref. [9j, 
we take the same benchmark point {m t i = 450 GeV 
and Mq = 1 TeV), and present our results in the 
r-SL space for fixed masses of t' and G' . All cross 
sections are computed using CalcHEP |10] with the 
same settings that are used in Ref. [9]. 

Nonperturbative bounds: A loose perturbative con- 
dition on the gauge couplings (< Att/\/Nc, N c = 3) 
in SU{3) ® 517(3) with a s = £/ 2 /(4vr) 0.1, gives 
the range of values for r, 0.15 < r < 6.7, where the 
tree-level results can be trusted. This is shown in 
Fig. [T]and labeled as 'Nonperturbative'. 

Vtb measurement: The t-W-b coupling is modi- 
fied by an extra factor of cl, as in Eq. [6l that is con- 
strained by Vtb measurements. Given that the mea- 
surement of single-top production at the Tevatron 
sets a limit on the coefficient of the t-W-b coupling, 
C L — Vtb 0.82, we find a nontrivial constraint on 
sl- 

s L < 0.57 . (8) 
This is incorporated in Fig. [Ha). 

Electroweak precision constraint: The modified 
electroweak couplings of the t quark as well as the 
new couplings of the W and Z bosons to the t' quark 
have an impact on electroweak observables. Most 
notably, the W and Z boson masses get one-loop 
corrections such that the T parameter is given in 
Refs. [3j [9] . Following Ref. [9], we find the elec- 
troweak constraint in the m t i-si plane. Although 
this limit is more stringent than Eq. (JSj) as shown in 
Fig. [21 it is less robust: new physics may relax the 
electroweak fit without being discovered at the Teva- 
tron or LHC. For example, leptophobic Z' bosons 
or complex Higgs triplets can give negative contri- 
butions to T, allowing larger values for sl- For this 
reason we will not consider seriously the electroweak 
constraints in what follows. 

Di-jet limit: If the production of t' quarks is en- 
hanced via an s-channel resonance (G'), one needs to 
consider limits from di-jet resonance searches. The 
CDF search for dijet resonances in 1.1 fb^ 1 of data 
has ruled out a gluon-prime of mass up to 1.25 TeV 
|llj . assuming that it couples to all quarks as the 
usual gluon. In our model, though, the branching 
fraction into jets is parametrically smaller by a fac- 
tor of r [9] (the dependence on sl is via the width of 
the gluon-prime and is very weak.) This is shown in 
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Figure 1: Current status for rrif = 450 GeV and Mq = 1 TeV. 
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Figure 2: Electroweak constraints. 

Fig. LT^a), where the di-jet limit is the horizontal line 
along the sl direction. The CDF limit is important 
in the low mass region (Mq < 1 TeV) while the high 
mass region (Mq > 1 TeV) is constrained by results 
from CMS [12] and ATLAS |13| . which are compa- 
rable. Fig. LUb) shows current di-jet constraints in 
the v-Mq plane with projected limits from both the 
Tevatron (in red) and the LHC (in blue), which are 
represented in dotted curves for 10 fb -1 . A choice of 
r <~ 0.3 and Mq > 1 TeV would easily evade the 
dijet limit at the LHC. 

tih search: The associated production of t and t' 
followed by t' — > th boosts the Higgs search in the tih 
final state. We include results from the CDF study 
with 7.5 fb -1 |14j . assuming a higgs mass = 120 
GeV, which reduces the allowed values of both r and 
sl from the upper-right corner as shown in Fig. []Ja). 



The larger r is better for larger production cross sec- 
tion of the s-channel resonance while the larger sl 
leads to the larger associated production. 

ti resonance search: The constraint on the ti 
resonance search is updated with the most recent 
results [15) . Since both t and t' lead to the same 
W + bW~b final state, both contributions are added 
(CDF does not require the equal mass constraint, 
m w + b = m w -i ). We considered a Higgs mass of 
m/i = 120 GeV. For a larger Higgs mass, the con- 
straint becomes more stringent due to the increased 
branching fraction of the top-prime to W + b. The 
current search gives a stronger limit on r compared 
to the dijet limit due to lack of analysis with a larger 
data set in the latter case. 

t' search in W + bW~b final state: The experi- 
mental collaborations have looked for t' pair-production 
with t! decay to W + b. The most recent results are 
from the CDF [16] and CMS collaborations [17] , In 
the current study, CMS used data taken up to 573 
pb _1 for the electron final state and 821 pb _1 for 
the muon final state. This limit is stronger than the 
CDF limit with 5.6 fb -1 . This search is complemen- 
tary to the previous searches and reduces the small 
sl region. 

t' search in tiZZ final state: CMS has looked for 
the t' in the t Z final state as well [18] . They select 
two leptons from the Z boson as well as an addi- 
tional isolated charged lepton. Their observed 95% 
C.L. cross-section limit assuming a 100% branching 
fraction to t Z is 0.44 pb to 1.09 pb for the top-prime 
mass in the 250 GeV to 550 GeV range. Their cur- 
rent limit is weak in our model due to a small branch- 
ing fraction of the top-prime into the top and Z fi- 
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nal state, which is about 20% or less for the chosen 
point. 

Our updated analysis with more recent experi- 
mental data in Fig. [I] shows that all the constraints 
that we have considered are complementary to each 
other, and a benchmark point that was studied in 
Ref. [9] is now disfavored. 

4 Counting Multi-Lepton Events 

As discussed in the previous section, searches in dif- 
ferent final states tend to cover different parts of al- 
lowed parameter space. Therefore it is desirable to 
look at other possible decay modes and study their 
implications. Searches for new physics in high multi- 
plicity events are an especially important component 
of the LHC program and complementary to analyses 
that have been performed. So far we have focused 
on either pair production or associated production 
separately, depending on the final states of interest. 
We propose to look for multi-lepton events that arise 
from both top-prime pair production and top associ- 
ated production. The decay modes of the top-prime 
that we consider are t! — > tZ and t' — > W + b. We 
do not consider the decay of top-prime to Higgs-top 
not only because it is small but also it would depend 
on the Higgs mass, although in principle it is possi- 
ble to have more dramatic signal events, allowing the 
Higgs decay to two photons or two Ws (see Ref. [19] 
for discussion on multi-lepton signals from the Higgs 
boson). As an illustration, we take a benchmark sce- 
nario, sl = 0.3 and r = 0.3 and present the number 
of multi-lepton events in the ntf-Mc plane. 

We parameterize the relevant branching fractions 
as follows. 

b zt = Br(t'^Zt), (9) 
b Wb = Br(t'^W + b), (10) 
b z>2l = BR{Z^l+r) = 0.067, (11) 
b w ,n = BR{W + t+u e ) = 0.22 . (12) 

For the benchmark point, bzt ~ 0.2 and b\^b ~ 0.5 
throughout most of the mass space (m t ', Mq and 
rrih). If we choose the branching fractions to be 
equal to the values above, we will get a conserva- 
tive estimate of the number of multi-lepton events 
for two reasons: First, if we were to include the 
t' — > t h decay we could get more multi-lepton events 
from Higgs decays to di-boson pairs. Second, if the 
t' — > t h decay channel were closed then bzt and by/b 
would naturally be larger. Based on these individ- 
ual branching fractions, one can easily obtain the 
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Table 1: Branching fractions of t't' and t'i+tt' events 
to Ni leptons that are calculated using the individual 
branching fractions given in Eqs. ([9 ll2p . 

branching fractions of t't' and t'i+tt' events to Ng 
leptons, as shown in Table [TJ 

In our study, we consider Ng > 3, and follow 
the same procedure as in a recent CMS analysis on 
multi-lepton final states [18]. First, we reproduce 
their estimate of the background cross sections which 
are presented in Table [2j We use MadGraph/MadEvent 
5 [20 for the cross section estimation and cross checked 
them using CalcHEP [10]. After all of the cuts, 
the number of expected background events is 4.6 ± 
1.0 with 3.0 ± 0.8 from dilepton with a non-prompt 
lepton from a fake (which is potentially further re- 
ducible), and 1.6+0.5 from genuine tri-lepton events. 
The actual number of observed tri-lepton candidate 
events is 7 [18] . The number of background events 
is small so we do not pursue further background 
analysis and use the results in |18| . In the future 
further background reduction from for example b- 
tagging should be very useful with higher statistics 
datasets. 

For the multi-lepton signals we generate events 
with MadGraph 5 [23] at the LHC with a 7 TeV cen- 
ter of mass. To estimate the kinematic acceptance of 
the signal events we employ the same kinematic cuts 
as in Ref. [18] . Electrons and muons are required to 
have pt > 20 GeV within |?7| < 2.4, while we use 
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Process 


Cross section (pbj 


W ± Z 


10.6 


zz 


4.1 


ttw ± 


0.13 


tiZ 


0.1 



Table 2: SM backgrounds for the multi-lepton signal 
events. The cross sections have been estimated by 
MadGraph and cross checked with CalcHEP. 

Pt > 25 GeV and \rj\ < 2.4 for jets (ignoring the 
detector gap, 1.44 < \rj\ < 1.57 between the barrel 
and endcap regions.) 

For particle isolation, we require that jets are 
separated by a AR > 0.4 with respect to both jets 
and leptons. Leptons must have a separation of 
AR > 0.1 with respect to other leptons. We se- 
lect events with at least three leptons and at least 
two jets after the isolation cuts. Having three lep- 
tons in the final state requires a leptonic decay of a 
Z-boson. Therefore, at least one lepton pair should 
have an invariant mass within 60 GeV < Mm < 120 
GeV. Additional reduction of the SM backgrounds 
is obtained by requiring 

R t = Z~2, P T ^ et ^ + Pr(lepto nj ) > 80 GeV, 

#1,2 #1,2 

where the i,j ^ 1,2 indicates that the scalar sums 
extend over all leptons and jets, except the two highest- 
Pt ones. With these cuts we can calculate the ac- 
ceptance efficiencies for each allowed channel in the 
G'-t' mass parameter space. 

The overall kinematic acceptance is 50%-60% in 
most of the parameter space. Above certain masses 
(in both m t i and Mq), the kinematic acceptance be- 
comes almost constant, ~ 50%. The CMS collabo- 
ration has observed a total of 7 tri-lepton candidate 
events for an expected background of 4. 6± 1.0 events 
at an integrated luminosity of C = 1.14 fb -1 |18j . 
We calculate overall efficiencies (e) for associated 
production and pair production including an addi- 
tional estimated experimental detection factor of ~ 
0.6 to roughly match the efficiencies for pair pro- 
duction without gluon-prime quoted by CMS. This 
results in a total efficiency of ~30%-35%. Finally in 
Fig. [3] we show the number of multi-lepton events 
Ni = an x BR x e x C for our study point, r = 0.3 
and sl = 0.3. The dotted (dashed) contours repre- 
sent the number of 3-lepton (4-lepton) events in red 
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Figure 3: Number of signal events (N() for a bench- 
mark point, r = 0.3 and sl = 0.3, Ng = ai x 
BR x e x C Four-lepton events in blue and tri- 
lepton events in red contours. The solid contour 
(in red) shows the current exclusion limit, including 
both pair and associated production. 

(in blue). The solid contour shows our estimate of 
the number of tri-lepton events (labelled as '10') ex- 
cluded by the CMS data at 95% C.L. including both 
pair (t'i') and associated production {ti' + t'i). The 
exclusion estimate of 10 events is a conservative es- 
timate based on the approach of Ref . |21j . The mass 
space below these contours predict more leptons and 
hence it is ruled out by current searches. 

5 Discussion 

The first discovery of physics beyond the SM could 
consist of signals from an effective theory that in- 
cludes one or two new particles. The number of 
interesting theories of this type is limited because 
particles are identified by a few quantum numbers 
(especially spin and gauge charges) which take only a 
small number of discrete values. Well-known exam- 
ples include Z' bosons, vector- like quarks or singlet 
scalars. In this article, we have considered a sim- 
ple model with a vector-like top-prime quark and a 
massive spin-1 color-octet gluon-prime boson. They 
naturally arise from an SU (3)i x SU (3)2 gauge group 
spontaneously broken down to its diagonal QCD group. 
Such a pattern of gauge symmetry breaking arises 
in many models beyond the Standard Model. In 
spite of only two new particles, the model is limited 
by various experimental constraints from Vtb mea- 
surement, EW precision measurements, dijet search, 
tih search, ti resonance search, t' search, etc. We 
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have updated the earlier study with more recent 
data from both Tevatron and LHC, and suggested 
the multi-lepton channel in the search for t' and G' 
particles. We have illustrated this by taking a study 
point, sl = 0.3 and r = 0.3. The multi-lepton chan- 
nels suffer from small branching fractions but the 
backgrounds are small and the signature is clean. 
We have shown that the current multi-lepton search 
analysis can constrain the relevant parameter space 
quite effectively, and provide increased sensitivity 
to models with a top-prime quark and gluon-prime. 
Different search strategies would confirm a discovery 
or corroborate the limit on non-existence of the new 
particles. Such searches in high multiplicity events 
are complementary to analyses that have been done 
and are quite important to the overall program at 
the LHC. 

It is a relatively easy task to look for multi- 
lepton events, if the rate is significant enough. How- 
ever, proving those events are coming from a if and 
G' is non-trivial. The first step to understand this 
would be to measure their masses. Fortunately, even 
in the presence of missing transverse momentum, 
it is well known that a complete mass reconstruc- 
tion is possible via various kinematic methods (see 
[221123] for recent reviews.). For example, consider 
the 4-lepton events, pp ->■ G' ->• tt! + t'i ->■ ttZ ->■ 
W+W-Zbb ^bb£+£- i'+ t'~ £y< with m t ,=750 
GeV and M G = 1400 GeV. First, a global and in- 
clusive variable Vl m i n [MIES] provides mass infor- 
mation of the G' . It does not appear as a resonance 
since there are two missing particles but the V§min 
shows a clear end-point, as shown in Fig. Ufa). The 
width of G' can be measured from the tail of the 
V$min distribution. When one looks at events ex- 
clusively, one has to worry about all combinatorial 
issues even among the signal due to high multiplicity 
of leptons [26]. Employing the invariant mass, it is 
not hard to choose the two leptons which came from 
the Z. Ignoring these leptons, one can form a sub- 
system Mt2 |2Z] with two leptons and two jets. Tak- 
ing the minimum of the Mt2 values of two possible 
combinations, one can confirm the mass of the top 
(see Fig. HJc)). Now including the dilepton from the 
Z, one can form another M?2 (see Fig. H(d)), which 
shows the mass of t' as an end point. Furthermore 
one can form various invariant mass distributions of 
(Z, b,£), (Z, b) and (b,£), which provide independent 
constraints (see Fig. Sfb) for Mzb-)- 

For the two M?2 distributions, we consider the 
minimum of all possible combinations while both 



contributions are shown together in Fig. H^b) for 
the invariant mass distribution of Z and b. If one 
can take the minimum even in this case, there are 
fewer events above the expected end point but the 
distribution is not as sharp as it could be. The mass 
of t' also may be extracted from the two expected 
end points in the invariant mass of (Z, b), which are 
given by 





= m 2 + m 2 z + 2(E 2 E 2 z ± 


\Pb\ \Pz\ ), 


El 


= ml + \p b \ 2 , 


(13) 
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= m z + \p z \ , 


(14) 


\n? 


= \ (m 2 , merrily) , 


(15) 


Wz\ 2 


= \(m 2 z ,m 2 ,m 2 ) , 


(16) 



where X(x, y, z) = - +y +z -2( x v+y z + zx ) ^ anc j cor _ 
responding values are 648 GeV and 94 GeV, respec- 
tively. A more complicated structure is obtained for 
the M Z u case [28]. 
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Figure 4: Various kinematic distributions for mass 
determination, (a) \fl m in (b) M Z b (c) (d) 
My 2 - Vertical lines indicate the corresponding kine- 
matic end points. 
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